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1. Introduction 



Whenever cost parameters in standard inventory models 
become difficult if not impossible to assess, one is often forced 
to examine criteria other than the classical minimum cost of the 
operation as a measure of effectiveness. This consideration is 
particularly pertinent to military supply systems wherein the 
traditional "out-of-stock" cost has to be measured in such intan- 
gible terms as loss of mission. On the other hand, current budget 
considerations being what they are, there is a renewed interest 
in controlling the "other" traditional cost factor of holding 
too much stock to overprotect the out-of -stock position. Faced 
with truly random demands on the supply system, however, it is 
practically certain that one or the other of these two undesirable 
states will have to be tolerated as time progresses. It naturally 
follows that the more accurately that random demand can be pre- 
dicted, the better control one has over the system. Indeed, in 
a completely deterministic model, where demands are assumed known 
with certainty, it is possible to structure models (as in Ref [5]) 
so as to never be out of stock; the system can then be operated 
optimally with respect to other parameter choices in a simple, 
and fairly self -regulatory manner. 

The problem of forecasting demand thus arises as a very 
important one in the context of several models presently employed 
by NAVSUP. Several previous reports ([1], [2] and [3]) have 

addressed different aspects of some of the difficulties involved 
in demand forecasting, with special emphasis on statistical 



considerations. In particular, the method of exponential 
smoothing, initiated by Brown [4] and presently used extensively 
by NAVSUP, has been the focus of special attention and analyzed 
in some depth in those studies. The present report continues 
that general study and provides some answers to issues that were 
raised and left unsettled in the previous reports. 

One of the problems associated with forecasting has to do 
with the variability of the forecasts. So much attention is often 
paid to the accuracy (in the expected value sense) of the fore- 
cast that it is easy for variability to become slighted. But in 
fact, no matter how well the scheme used forecasts mean demand, 
a large associated variance leaves the decision maker with little 
in the way of control. This problem is especially highlighted in 
traditional periodic review models where large buys are made early 
in the period to protect against what was an accurate but extremely 
variable forecast that never materializes. The result and unneces- 
sary drain on a constrained budget creates an obvious dilemma. 

So, while we would like accurate forecasts, we should equally well 
look for precise ones in the sense of having a small variance. 

In previous reports, an issue was made over the fact that 
exponential smoothing, coupled with MAD as an estimate of varia- 
bility, seems to produce excessive variability in the reorder 
levels even under stable assumptions. In the next section, this 
point is pursued further to determine the extent to which fore- 
casting might be improved upon within the context of smoothing as 
a technique. Results are given only for the normal distribution 
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with a constant mean and variance. While this is admittedly a 
special case, it is after all an important one which in fact 
applies as a model to a number of inventory items. But more 
importantly, the modifications suggested for comparison were best 
studied under such controlled assumptions to reveal the effects 
on variability. 

In Section 3, the main purpose of the present study is 
explored. That purpose is to examine the effects on various fore- 
casting techniques of a changing mean value function. The examina- 
tion has in turn come about as a result of suggestions from NAVSUP 
that, while a constant mean model may be a valid assumption in a 
given period (quarter) , that constant value changes from quarter 
to quarter for many different items in the inventory system. Thus, 
while exponential smoothing is not an optimal procedure to employ 
in a constant mean model (as pointed out in [3]) it may be more 
so in the case of a varying mean. Indeed, such a case would 
appear to lend itself quite well to some kind of adaptive scheme 
such as exponential smoothing. Several alternatives, along with 
smoothing at two levels, are tested against several different 
models of a changing mean demand. Again, only the normal case 
is examined in this study. For reasons documented earlier, com- 
parisons are made via computer simulation and the associated pro- 
gram elements are summarized in appendices to this report. 

In order to test some of these results with real data, the 
authors requested and received actual demand data on 10,000 
different items for eight quarters. The analysis of these data 
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is presented in Section 4 along with the usual precautions against 
overgeneralization with such limited information. Finally, some 
recommendations for further study are presented in a concluding 
section along with some remarks about processing times. 
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2. Variability of Smoothing 

In previous reports already cited ( [2] in particular) the 
problems associated with forecast variability have been discussed. 
Special attention was given to the variability associated with 
exponential smoothing and MAD (Mean Absolute Deviation) . This 
section is a continuation of that study with special attention to 
the effect in particular on reorder levels. 

The theoretical basis for the present discussion is the 
following: Suppose that random demand in a periodic review inven- 

tory model is normally distributed with constant mean y and 
standard deviation a. Since both of these parameters are typically 
unknown, they must be estimated from data. Such estimators are 
themselves random variables subject to fluctuation and must, per- 
force, be inexact. Any application of such estimates are then 
subject to the same inexactness and, in particular, reorder levels 
will be so affected. 

It is standard in these circumstances to adopt a reorder 
level of the form R = y + Ka where K is chosen to satisfy a 
given risk (stockout) requirement. More specifically, if 0 < p < 1 
is a specified stockout risk, then, 

(1) p = Pr(X>R) = Pr(X>y+Ka) 

defines K, where X is the random demand. Obviously K is 

th 

then the 100 (1-p) — percentile of the standard normal distribu- 
tion and may be found from published tables. Some standard values 
of K are 1.23, 1.64, 1.96 and 2.57 associated, respectively, 
with risk values of .10, .05, .025 and .005. 
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The fact that X is random in the first place is what 
forces us to even consider a stockout risk. Thus, even if \i 
and o were precisely known, there is no way to guarantee that 
random demand will never exceed a reorder level, wherever we set 
it. Thus, we adopt a risk value that we are willing to tolerate 
and choose K to set the reorder level accordingly. The thing 
that prevents us from making p too small, of course, is that 
the corresponding value of K increases as does R and, if the 
demand does not materialize, we are left with an oversupply of 
items for which a holding penalty of some sort must be assessed. 
There is thus a need for a trade-off between these two opposing 
penalties . 

The situation becomes even more complex when we do not 
know y and a. Indeed, however they might be estimated by, 

/N ^ 

say y and a, respectively, the corresponding estimated reorder 
level R = y + Ka is very likely different from R. Two awkward 
situations then arise. First, if R < R, the theoretical value, 
the corresponding risk is inflated, which is to say 

Pr(X>R) > Pr(X>R) = p. 

Thus, the probability of running out of stock is greater than p, 
the required stockout risk. On the other hand, if R > R, there 
is, of course, a corresponding reduction in risk but only at the 
expense of overstocking items and paying the holding penalty. 

The present study does not address the complex problem of 
giving a utility value to these two penalties. Thus, it may 
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indeed be more desirable to overstock and pay a holding cost 
(achieving a stockout risk even smaller than required) than to 
hold less stock and allow the corresponding stockout risk to 
inflate. The point of view here is that both situations are to 
be avoided if possible and our main interest is in the statistical 

/N 

nature of R with special attention to its variability. 

There are, of course, infinitely many ways to estimate R 
in the given circumstances. Unfortunately, not all of them pro- 
duce random variables whose probability distributions are mathe- 
matically tractable. In particular, when exponential smoothing 
is adopted as an averaging technique, and when a is estimated 
by means of MAD as well, such tractability is particularly elusive, 
as documented previously. For this reason, simulation, with its 
inherent inconclusiveness, was adopted in previous reports to 
evaluate statistical characteristics. Additional efforts not- 
withstanding, the intractability remains and simulation is again 
used in this report as a basic tool for analyzing variability. 

When demand is assumed normal with the same parameters 
from period to period — certainly a very special case — a lot is 
known about the estimation problem. In particular, if maximum 
likelihood estimates of y and a respectively are substituted 
(using the invariance principle) into the formula for R, the 
corresponding estimate of R is itself maximum likelihood with 
its attendant optimum properties stemming from Gauss-Markov con- 
siderations. Consequently, we may use the maximum likelihood 
estimate as a norm of sorts against which to judge other estimators. 
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To gain better insight into the source of variability, we will 
here examine variations of exponential smoothing and MAD and 
compare the results accordingly. 



In particular, we consider smoothed estimates of y and 
a as documented in previous reports. That is, if data x^^,X 2 , 
are given. 



y 



a 



t -1 



I 

k =0 



ok 

3 X 



t-k 



and 






a = 2 : 



where 



A 



a 



t -1 



I 

k =0 




f 



/N 

G , 1 ^ X , 1 X , •» 

t-k t-k t-k- 1 . 



^t-k -1 



t-k -2 . 

= a I 3^ 

j =0 



X. , , . . 

t-k- 1-3 



In words, is the forecast of time t-k-1, 

based oh exponential smoothing of data ' • * * '^t-k -1 ’^sing a 

smoothing constant of a ( 3 = 1 -a); is the forecast error, 

being the difference between the actual demand at time t-k and 

what was forecast one period earlier; K is the exponentially 

smoothed estimate of error MAD (A^) . The formula for a stems 

from the fact that, under the normal distribution assumptions, 

the error standard deviation related to the error MAD 

by means of a = /J A_ and in turn, o is related to a by 
■' e 2 e ' e 

a = J least asymptotically, i.e. for large values of t. 
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Basically, with these definitions in mind, NAVSUP presently 
estimates R with the formula 

(3) R = y + Ka. 



In the sequel, we will refer to this as Method A . 

In our previous studies, we established that a great deal 

/N 

of the variability in R stemmed from the excessive variability 

in a and confirmed this by examining the mean squared error of 
/\ 

a as an estimate of a in many cases, that is, over a wide 
range of parameter choices. But, to what extent is that excess 
variability due to the smoothing operator itself versus the use 
of MAD to measure variability? To isolate these contributory 
factors, as well as to test the sensitivity of the results to 

/V 

parameter choices (a in particular) , several variations of a 
were chosen. 

First, we agree to use a smoothed estimate of y , that is 
y as defined in (2) to keep that part of the estimate of R 
constant to each variation of the method. Then, Method B is 
defined by using a squared version of forecast error in place of 
absolute value based on smoothing. Thus, smoothed squared fore- 
cast error becomes 



a 



t-1 



I 

k=0 



e 



2 

t-k 



and, to convert back into the unit of scale, the square root is 
taken and the corresponding estimate of a becomes. 
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a E 



/s. 




/^. AzV 

k=0 



e 



2 

t-k • 



For Method B then, the estimated reorder level is given by 



(4) 



R = y + Ka . 



when compared to Method A, we should see the effect of absolute 
value (MAD) on the variability. 

For our third variation, we use ordinary averaging on 
squared forecast error in place of smoothing to test the contribu- 
tion of the latter. Thus, for Method C we estimate a by 



a 






t 



1 

k=l 



e 



2 

k 



Accordingly, the estimated reorder level becomes 
(5) R = y + 

In our fourth method we test the contribution of both 
smoothing and MAD by dropping them altogether, estimating a by 
maximum likelihood but continuing to smooth the data to estimate 
y. In Method D then. 







I (X, -x) ^ where x = ^ I x. 
t k=l ^ t 3 



and the estimated reorder level becomes. 



R 



y + Ka, 



( 6 ) 



Finally, we label our norm, wherein both y and a are 
estimated by maximum likelihood, as Method E . In that case, the 
estimated reorder level is maximum likelihood as previously 
pointed out. That is, 

(7) R = X + 

There are a variety of ways that these five methods might 
be compared and we examined several. For present reporting pur- 
poses, however, we were content to examine the effects on reorder 
levels. For simulation purposes, the following general considera- 
tions apply. (More particulars may be found in the program summary 
in Appendix A.) First, our main concern here is with statistical 
characteristics. In the absence of analytical results we must 
have a large sample size (t) and t = 100 seemed comfortable. 
Again, we emphasize that our present concern is not with the real 
application where a history of 100 periods might be totally 
unreasonable. Secondly, since we are simulating, we need to repli- 
cate the system a large number of times and we chose NR = 100 
for the number of replications in each case. Finally, it is 
necessary to restrict ourselves to a selective choice of parameters, 
notably the smoothing constant a, the mean y and the standard 
deviation o of the underlying demand, the risk level p and, 
as a consequence, what we will refer to as the theoretical reorder 
level R = y + Ka . The basic parameter choices were made as a 
result of examining our previous reports for those choices where 
differences were particularly marked. 
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For each choice of y, o, p and R, the scenario was 
duplicated for a = .1 and a = .2 which are two choices 
presently in vogue in applications. The basic results are sum- 
marized in Tables 2.1, 2.2 and 2.3. In these tables, we have 
published, for each choice of parameters under each of methods 
A, B, C, D and E the following characteristics: 

1. Average reorder level, being the average over 100 replica- 

th 

tions of the reorder level set at the end of the 100— period of 
demand. 

2. The standard deviation of the 100 reorder levels (replica- 
tions) set at the end of period 100. 

3. Using three sigma limits as a guide. Oversupply is defined 
as the number of units over the reorder level R that might be 
encountered . 

4. Again, using three sigma as a range. Max Risk is recorded 
as the actual value of p that might be encountered. 

Items 3 and 4, as recorded in the tables, need additional 
discussion. Imagine the 100 replications as 100 supply managers, 
each managing the same item for 100 periods. The first case 
listed in Table 2.1 will do for an illustration. The theoretical 
reorder level is 116.45 to satisfy a stockout risk of 5%. In 
Item 1 in the table is recorded, for each method being considered, 
the average of the 100 reorder levels that each of the supply 
managers would record after 100 periods of operation. Immediately 
under that in Item 2 is listed the corresponding standard devia- 
tion of those reorder levels. It is easily observed that on the 
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REORDER LEVEL 



PARAMETERS 


1 . Average 

2. Standard Deviation 

3. Oversupply 

4. Max Risk 


a 


M 


0 


P 


R 


A 


B 


C 


D 


E 












116.68 


116.32 


116.55 


116.50 


116.55 


.1, 


100, 


10, 


. 05, 


116.45 


3.51 

10.76 


3.42 

10.13 


2.37 

7.21 


2.37 

7.16 


1.47 

4.51 












.27 


.27 


. 17 


.17 


.11 












116.78 


116.22 


116.57 


116.53 


116.55 


.2, 


100, 


10, 


.05, 


116.45 


5.40 

16.53 


5.07 

14.98 


3.48 

10.56 


3.47 

10.51 


1.47 

4.51 












.48 


.46 


. 27 


. 27 


.11 












26.68 


26.33 


26.55 


26.49 


26.53 


.1, 


10, 


10, 


.05, 


26.45 


3.49 

10.70 


3.39 

10.05 


2 . 34 
7.12 


2.34 

7.06 


1.41 

4.31 












. 27 


. 27 


.17 


.17 


.11 












26.78 


26.22 


26.57 


26.51 


26.53 


.2, 


10, 


10, 


.05, 


26.45 


5.39 

16.50 


5.05 

14.92 


3.46 

10.50 


3.45 

10.41 


1.41 

4.31 












.48 


.46 


. 27 


. 27 


.11 












141.69 


140.81 


141. 38 


141.22 


141.34 


.1, 


100, 


25, 


.05, 


141.125 


8.73 

26.76 


8.48 

25.12 


5.87 

17.87 


5.86 

17.68 


3.54 

10.84 












.27 


.27 


. 17 


.17 


.11 












141.96 


140.56 


141.43 


141.28 


141.34 


.2, 


100, 


25, 


.05, 


141.125 


13.47 

41.24 


12.62 

37.30 


8.65 

26.26 


8.62 

26.02 


3.54 

10.84 












.48 


.46 


. 27 


.27 


.11 



Table 2.1. Effects on Reorder Levels. 
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REORDER LEVEL 



PARAMETERS 


1. Average 

2. Standard Deviation 

3. Oversupply 

4. Max Risk 


a 


y 


0 


p 


R 


A 


B 


C 


D 


E 












66.68 


66 . 32 


66.55 


66.49 


66 . 54 












3.50 


3.40 


2.36 


2.35 


1.44 


.1, 


50, 


10, 


.05, 


66.45 


10.73 


10.07 


7.18 


7.09 


4.41 












.27 


.27 


.17 


. 17 


.11 












66.78 


66.22 


66.57 


66.51 


66.54 












5.40 


5.06 


3.47 


3.46 


1.44 


.2, 


50, 


10, 


.05, 


66.45 


16.53 


14.95 


10.53 


10.44 


4.41 












.48 


.46 


. 27 


.27 


.11 












112.89 


112.75 


112.96 


112.94 


112.76 












3.26 


3.13 


2.46 


2.48 


1.46 


.1, 


100, 


10, 


.10, 


112.82 


9.85 


9.32 


7.52 


7.56 


4.32 












.38 


. 37 


.29 


.29 


.20 












112.71 


112.46 


112.92 


112.90 


112.76 












4.85 


4.65 


3.45 


3.45 


1.46 


.2, 


100, 


10, 


.10, 


112.82 


14.44 


13.59 


10.45 


10.43 


4.32 












.57 


.56 


.40 


.40 


.20 












108.55 


108.45 


108.60 


108.58 


108.40 












2.78 


2.69 


2.35 


2.38 


1.29 


.1, 


100, 


10, 


.20, 


108.42 ■ 


8.47 


8.10 


7.23 


7.30 


3.85 












.49 


.48 


.44 


.44 


.33 












108.42 


108.25 


108.56 


108.55 


108.40 












4.09 


3.98 


3.37 


3.38 


1.29 


.2, 


100, 


10, 


.20, 


108.42 


12.27 


11.77 


10.25 


10.27 


3.85 












.65 


.64 


.56 


.56 


.33 



Table 2.2. Continuation of Table 2.1. 
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REORDER LEVEL 



PARAMETERS 


1. Average 

2 . Standard Deviation 

3. Over supply 

4. Max Risk 


a 


V o 


p 


R 


A 


B 


C 


D 


E 










106.89 


106.82 


106.93 


106.92 


106.74 










2.62 


2.57 


2.35 


2.34 


1.23 


.1, 


100, 10, 


.25, 


106.74 


8.01 


7.79 


7.24 


7.20 


3.69 










.54 


.54 


.50 


.50 


. 38 










106.78 


106.65 


106.89 


106.89 


106.74 










3.85 


3.77 


3.35 


3.35 


1.23 


.2, 


100, 10, 


.25, 


106.74 


11.59 


11.22 


10.20 


10.20 


3.69 










.68 


.68 


.63 


.63 


.38 










11.61 


11.57 


11.60 


11.58 


11.58 










.44 


.41 


. 37 


. 37 


. 35 


.1, 


10, 1, 


.05, 


11.645 


1.28 


1.16 


1.06 


1.04 


.98 










. 39 


. 37 


. 31 


. 32 


.30 










11.59 


11.54 


11.60 


11.57 


11.58 










.59 


.55 


.44 


.44 


.35 


.2, 


10, 1, 


.05, 


11.645 


1.72 


1.54 


1.28 


1.24 


.98 










.57 


.54 


.39 


.40 


. 30 



Table 2.3. Continuation of Table 2.2. 
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average all methods do well in yielding a reorder level near the 



theoretical one. But that is an average reorder level. For each 
method we might ask just how widespread were the actual reorder 
levels that went in to make up the average? Well, there are two 
ways here to measure "bad." At one extreme, using three sigma 
as a guide, it is plausible that some of the 100 supply managers 
experienced reorder levels as high as the average plus three sigma 
and others as low as the average minus three sigma. For example, 
under Method A at least one of the supply managers might have 
recorded a reorder level of 127.21, thus carrying 10.76 items 
more than he would have had he known the parameters y and a. 

By the same token, at least one other manager might have estimated 
R to be as low as 106.15 in which case the actual stockout risk 
he faces would be 27%, not 5%. This has been recorded, for lack 
of a better name, as Max Risk in Item 4 of each table. 

Now looking at the three tables as a whole, some definite 
conclusions may be drawn. The actual numbers recorded as Over- 
supply and Max Risk may or may not be significant. These consid- 
erations would depend on the unit cost on the one hand, and on 
the penalty cost for being out of stock on the other hand. Natur- 
ally, these will vary from one item to another and no attempt 
will be made here to qualify those entries further. What is of 
concern here is the unmistakable trend toward improvement — either 
way — as we proceed from Method A to Method E, that is from smooth- 
ing with MAD to complete maximum likelihood. Except for Methods C 
and D, which are always quite close in value and occasionally 
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reverse the order, the improvement trend is overwhelmingly in the 
stated order. While this does not constitute analytical proof by 
any means, it certainly lends a great deal of support to the con- 
jecture that, under the assiamptions stated, exponential smoothing 
produces greater variability than maximum likelihood. 

But much more can be gleaned out of the results! We set 
out to test variations of smoothing and the results are ordered 
in a natural sequence. Starting with smoothed estimates of y 
and a via MAD, some improvement in both Max Risk and Oversupply 
(however slight) is achieved simply by smoothing squared forecast 
error rather than absolute forecast error. That is Method B. But 
the improvement is slight in most cases which supports the con- 
jecture that MAD per se is not the largest contributor to varia- 
bility. 

Method C begins to test the contribution of smoothing since 
it differs from Method B only in averaging squared forecast error 
in the traditional sense rather than a smoothed average. In most 
cases, a reasonable amount of improvement results. We have already 
remarked that Method D produces results quite similar and occasion- 
ally just slightly better than Method C. Since the only difference 
is averaging squared deviations from the mean rather than squared 
forecast errors, one may guess that the introduction of the latter 
is not too significant in contributing to variability. 

Finally, in Method E, y itself is estimated by maximum 
likelihood along with a and the results speak for themselves 
and confirm once again what has been repeatedly observed in previous 
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reports. No need to belabor that point here but we may say in 
conclusion that it appears to be the method of exponential smooth- 
ing that is the real villain in inflating the variability of the 
reorder level — and that is true after 100 periods of operation it 
should be pointed outl Additionally, we can see from the tables 
that the choice of a = .2 uniformly produces worse results than 
the choice a = .1, and that improvement is directly proportional 
to a. The unmistakable guideline resulting from all this seems 
to be: If there is any reason to believe that demand is normal 

with constant parameters over time, do not smooth, and if you do, 
choose a small value of a. In any case, be aware of the fact 
that the smoothing operator appears to produce more variability, 
hence more unnecessary cause for alarm (unreliable reorder levels) , 
than more traditional methods of averaging. 
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3. Variable Mean Demand 



It was, of course, predictable that smoothing would fare 
worse than maximiam likelihood in a constant mean model. The only 
question is just how inferior in such a case. As suggested in 
earlier reports, [3] in particular, smoothing is essentially an 
adaptive scheme and would appear to be more suitable for a situa- 
tion in which the mean value varies over time. One note of caution 
should be added, however. The fact that the actual demand itself 
varies from period to period does not itself indicate a changing 
mean value. Indeed, it is in the random nature of affairs that, 
particularly with large variances, an actual demand record may 
appear to vary a good deal from period to period when in fact the 
mean is constant. Whether or not the mean is constant, then, is 
a question of the model. 

But it is easy to imagine conditions for which a constant 
mean model is inappropriate. For example in a military supply 
system it is clear that the mean demand for certain kinds of parts 
should shift to a higher, even if constant, level during a sudden 
global crisis. Or, it might be that even though mean demand is 
constant, record keeping and reporting is of such a nature that 
demand records do not reflect such an assumption. The fact that 
a constant mean is inherent in the process is really of minor 
concern then to the decision maker who must base his actions on 
what he actually observes. More about this point in the next sec- 
tion where real demand data have been examined. 
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For these reasons we decided to compare exponential 
smoothing to other alternate forecasting schemes including maxi- 
mum likelihood under various mean value functions, a program 
suggested in [3] as a continuation of that study. But, how shall 
the mean value be allowed to vary? Without some regularity, it 
is almost certain that no general statements would be forthcoming. 
Moreover, recognizing the lack of analytical results for smoothing 
even in the constant mean model, simulation would almost surely 
have to be used as a method of generating statistical properties. 

With regard to the mean value function, the authors are 
aware of no study within NAVSUP to indicate just what assumptions 
would be realistic. Lacking that, five different patterns were 
selected as plausible assumptions for various situations reason- 
ably faced by military supply systems and, for purposes of gener- 
ating data and controlling the parameters, normal demand is 
universally assumed. Throughout this section, the five demand 
patterns are identified as follows: 

Pattern 1: Mean demand is allowed to increase by 50% in 

Period 3 and remain at that level thereafter. 

Pattern 2: Same as Pattern 1 except the increase in Period 3 

is 100%. 

Pattern 3: An impulse pattern wherein mean demand is allowed 

to increase in Period 3 by 100% and then immediately 
decreases to its previous level where it remains. 

Pattern 4: A ramp in which the mean value increases by 10% 

in each period starting with Period 3. 

Pattern 5: Same as Pattern 4 except that the mean value 

becomes and remains constant at its value in Period 4 . 
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As to the various forecasting schemes to be compared, 
originally the Bayesian method recommended in [3] was considered 
along with exponential smoothing, maximum likelihood and a moving 

average. Specifically, when demand is normal, N(y,a^), with 

« . . 
g known , and when the prior on y is taken to be also normal, 

N(yQ,gQ), with y^ and specified, there is a natural way 

to generate a posterior normal distribution at the end of each 

period using the posterior of the last period as the prior for 

the current one. In this way, one obtains a Bayes estimate, y^, 

of y (the mean of the posterior in each period) as a forecast 

of demand for the next period. Reorder levels may then be set 

at y^ + Kg.^^ As previously reported then, the ratio g^/g^ 

plays roughly the same role as a smoothing constant and in any 

case must be specified. But in simulation, g^ is deliberately 

selected and known, so that g^ can then be selected to reflect 

the relative degree of imperfect information. 

Four different Bayes cases were tested and were found to 
either be very inferior to the other schemes or at best equivalent 
to maximum likelihood (at least asymptotically) . Consequently, 
the Bayes procedures were abandoned in the early stages of this 
investigation and those results are not reported here. This is 
not to say, however, that Bayesian methods should be ignored in 
studying a variable mean. They are, after all, adaptive schemes 

^ When both y and are assumed unknown, not a lot is available 

in the way of prior assumptions that lead to tractable results. 

1 **{* 

A modification over what appears in [3] . 
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and, broadly speaking are quite amenable to precisely those 
situations. The particular scheme examined here is a very special 
one and may not be indicative of the potential of the class as a 
whole . 

Very much related to the abandonment of the Bayes schemes 
is the question of criteria for comparison. Naturally there are 
many ways in which forecasting methods might be judged. Clearly 
the ranking by one method might very well change if a different 
criterion were to be adopted. With no specific guidelines to 
dictate a choice, mean squared forecast error was finally selected 
as the criterion for comparison for several reasons. First, it 
has a certain amount of universal appeal as a measure of "closeness." 
And that after all, is our main concern in examining the inherent 
characteristics of each scheme as regards its forecasting ability. 
Secondly, mean squared error is functionally related to variance 
and, with all schemes judged (perhaps prematurely) to be accurate 
with respect to average, the results would also be a rough indica- 
tor of variability, which has been one of our main concerns in 
this and related studies. 

Finally, with regard to the total number of demand periods, 
we first felt constrained by the fact that only eight quarters of 
real data are presently maintained in the files by NAVSUP. On the 
other hand, this places severe limitations on maximum likelihood 
and moving averages especially. Hence, we decided to examine 
the status of forecast errors at the end of eight quarters and 
again at the end of twenty quarters. This allowed us to examine. 



22 



to some extent short of asymptotic conditions, the effect time 
might have on the results with obvious implications then for more 
data storage. Other time periods were examined but are not 
reported here. 

Initially, the number of replications in the simulation 
was allowed to vary over several values but, with an exception or 
two, the results reported here are based on 100 replications. We 
saw no significant changes when that figure was allowed to increase 
In any case, an outline of the program used is included in Appendix 
B so that the interested reader may generate his own data to 
validate these, as well as any other, observations recorded here. 

One disadvantage in adopting mean squared error as a cri- 
terion is the difficulty of interpreting the results as meaningful 
units of measurement error. This is especially true when it comes 
to comparing two or more methods. What does it mean to say, for 
example, that the mean squared forecast error of Method A after 

eight periods was 274.98 while that for Method B was 224.47? We 

can certainly say that Method B was better than Method A, but it 
would be very difficult to say how much better. And yet, for 

reasons already mentioned, we prefer to use this abstract criterion 

Consequently, we have summarized our results in terms of relative 
ranking, ever on the lookout for emerging rank patterns. These 
results are summarized in Tables 3.1 and 3.2. Some explanatory 
remarks and summary highlights are in order. 

Each set of rankings accompanies a choice of parameter 
quadruples (y,a,N,NR) in which y and a are the mean and 
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Table 3.1. Ranking when 
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Table 3.2. Ranking when o^/y 



standard deviation of normal demand, N is the number of periods 
for which demand is generated and forecast, and NR is the number 
of replications for simulation purposes. As demand is then gen- 
erated under each of the demand patterns previously discussed, 
four different methods of forecasting are used to forecast demand. 
These are designated for exponential smoothing with smoothing 

constant a = 0.1 and S 2 for exponential smoothing with a = 0.2; 
ML stands for maximum likelihood and MA for a moving average 
based on the most recent eight periods of demand. The exact for- 
mulas used, along with the initial conditions assumed for each 
method, are listed in Appendix B with the program summaries. 

Under the foregoing conditions then, demand is generated 
and forecast with the resultant cumulative forecast error recorded 
after N periods and averaged by dividing by N. The experiment 
is then replicated NR times and the resulting mean (NR) squared 
forecast error (MSFE) computed for each method under each demand 
pattern. For each demand pattern, the forecast schemes are ranked 
and recorded in the tables with the first one listed corresponding 
to the smallest mean squared forecast error. Occasionally, two 
such values are so close as to be (subjectively) considered as 
ties. In that case, no choice is made in the rankings. For example, 
for the parameter choice (10,1,20,100) under Demand Pattern 4, the 
respective mean squared forecast errors for S 2 , ML and 

MA are 35.38, 15.99, 71.95 and 15.84. It is thus relatively 
impossible to distinguish between S 2 and MA so that the ranking 
is listed as MA or S 2 / ML. Finally, a method has been 
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underlined now and then in the ranking list to indicate that its 
MSFE is of an order of magnitude greater than the rest, thereby 
singling it out as a particularly poor choice. 

As it turned out, the ranking patterns began to emerge 
according to variance-to-mean ratios and, accordingly, the summary 
tables are arranged so as to identify groups by values of cr^/y. 
Predictably, results are much more consistent and stable for small 
values of o^/\i in contrast to large values. In particular, for 
o^/u ^ 1 , it is almost always the case that the preference, in 
order of most preferred first, occurs as 82 / MA, ML for 

all demand patterns save one. For Pattern 3, the ordering is ML, 
Sj^, 82 , MA and this seems to be the one constant element in all 
cases. That is, for Pattern 3, maximum likelihood is preferred 
(if however slightly) to both forms of smoothing and the moving 
average is the worst choice. 

When a^/y > 1, results are not so clear cut except as 
just mentioned for Pattern 3. For Pattern 4, the preference order- 
ing is basically 82 / MA, ML; for Pattern 5, it is basic- 
ally ML, S 2 » MA as for Pattern 3. About all that can be 

said about Pattern 1 when a^/y >1, is that MA seems never to 
be preferred; otherwise, each of the other techniques occurs at 
least once on the preferred list. 

Finally, it might be remarked, as anticipated, that the 
standard deviations occur in roughly the same order as the MSFE 
ranks. This does not show up in the summary tables, however. It 
might also be observed that, basically, the increase in periods 
observed from N= 8 to N = 20 contributes little to the ordering 
scheme . 
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4. Sample Characteristics of Real Data 

The results of the previous section depend very much on 
the assumption that demand is normally distributed with a mean 
value that varies according to specific types of functions. At 
that, only five such functions were tested. And in each of those 
patterns the variance was held constant. Naturally, the applica- 
tion of such results to real data is severely restrictive, particu- 
larly in view of the fact that little documentation presently exists 
regarding the true nature of demand for many kinds of items managed 
by NAVSUP. We therefore set about to run similar comparisons on 
real data. Even though the underlying model for the data is 
unknown, one can still ask in retrospect, given the data, what 
would have happened had a different forecasting scheme been used? 

The data used to address this question were supplied from 
the files of the Ships Parts Control Center (SPCC) , Mechanicsburg , 
Pennsylvania, with the cooperation and assistance of Mssrs. R. 
Brumbaugh and J. Zerbe of the Fleet Material Support Office (FMSO) . 
Unfortunately, demand history is retained only for the current 
and seven previous quarters for a total of N = 8 quarters or 
periods. To help counterbalance this very small value, a relatively 
large sample of 10,000 items was taken. The sample included only 
secondary, non-reparable items and only recurring maintenance 
demand was considered. So-called insurance items (those for which 
demand is less than one per year) were excluded because they obviously 
generate special forecasting problems of their own, particularly 
in view of the short history of eight quarters. Even with these 
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items excluded, however, 859 of the 10,000 experienced no demand 
during the two-year period examined (1973-74) . 

A histogram displaying the frequency distribution of the 

data is displayed in Figure 4.1. The frequencies are graphed as 

proportions (out of 10,000) according to the average of the eight 

observations. The observed number (in each interval [a,b)) is 

listed at the end of each bar for further identification. From 

these data, it was determined that the ensemble mean is 13.545 

while the median is only 1.5. As a matter of additional interest, 
th 

the 90— percentile turned out to be 14.375. Incidentally, if 
from the 10,000 items, the 859 having zero records were eliminated, 
the sample mean would only be increased to 14.818. 

The fact that only eight quarters of demand are available 
poses several problems. All of our forecasting t;echniques require 
some initial assumptions at the beginning of the recorded demand 
period. For the two smoothing techniques (S^ and S 2 ) that amounts 
to an initial forecast. For the moving average (MA) technique, 
each of the preceding eight quarters would be needed, strictly 
speaking, to implement the technique. In the absence of such 
information, the assumption made here is that each of these is 
equal to some initial forecast. Maximum likelihood requires the 
entire past history so, to put things on an equitable footing, we 
assume that eight previous quarters is the entire past and that 
each observation in those quarters is equal to an initial forecast. 

This forces the beginning stage of each of our four fore- 
casting techniques to depend on an initial forecast. It was felt 
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Figure 4.1. Frequency of Sample Means 



that any systematic calculation of an initial forecast from the data 
might introduce extraneous bias in favor of one or the other of 
the techniques. It was therefore decided to use the ad hoc 
procedure of taking the midpoint of the range of observations 
being considered. Thus, for example, for all items whose average 
falls between 4.0 and 6.0 inclusive, an initial forecast of 5.0 
was used; for items whose averages are between 2.0 and 3.0, an 
initial forecast of 2.5 was used, and so on. 

One rather unexpected phenomenon observed in the sample 
data was the tendency for demands to be clumped together, rather 
than more evenly distributed throughout the eight observed quarters. 
A list of just a few such items is displayed in Figure 4.2. Such 
records, where an observed demand is much larger than expected 
and occuring rarely at that, make any kind of uniform assumption 
from quarter to quarter untenable. Certainly it makes the constant 
mean model, discussed in Section 2, extremely suspect. 
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Figure 4.2. Distribution by Quarters. 



31 



There are many possible explanations for this phenomenon. One 
possibility is that many of these demands are for storeroom stock 
at an end-use activity, or at some intermediate echelon. The actual 
use of the material may indeed be at a relatively uniform rate 
but the item is ordered in batches at these other levels.^ Or 
it may be that the demands themselves satisfy the uniform (identi- 
cally distributed) assumption well enough but the record keeping 
is of such a nature that they appear in this form. Nevertheless, 
a model for such records, if that is in fact what decisions will 
be based on, will have to take that into account. 

In order to compare the four forecasting methods under 
consideration, again the question of criteria or measures of 
effectiveness arises. For reasons previously discussed, mean 
squared forecast error was adopted. Using four different group- 
ings by a range of sample means, the average (N=8) forecast 
error for each of the four forecasting methods utilized in Section 
3 was computed. The number of items in each group then corresponds 
to NR in the simulations and permits the computation of an over- 
all mean squared forecast error (MSFE) . (Thus, the ad hoc group- 
ing was done to give a respectable value of NR for the group. ) 

This then allows us to order the forecast methods in order of 

preference as in Section 3. As a matter of added interest, the 

1 

standard deviation (SD) and the 90— percentile P^q are 
reported along with the mean squared forecast error. These results 

^With multiple users, such demands would tend to even out but 
most items of that type have been transferred to the Defense Supply 
Agency for management. 
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are summarized in Figure 4.3 where a group is defined by the 
indicated interval of means and NR, the total of such observa- 
tions available is also indicated for each group. 

Some obvious degrees of caution should be exercised in 
interpreting the results of the table. To repeat an earlier 
point, only N = 8 observations were available for computing 
purposes. This alone makes generalizations difficult. With so 
few items available in the mid-range values of means, observa- 
tions were grouped rather arbitrarily to make the value of NR 
reasonable. At that, only about 2500 of the 10,000 items were 
finally included in the comparisons. Finally, the initial assump- 
tions were selected on simply a rational basis and certainly 
affect the results. 

With those cautions in mind, however, it may be noted that 
the results are fairly consistent with the simulation results of 
the previous section particularly when compared to Demand Pattern 
3 of that section. This should not be too surprising since the 
batching we mentioned earlier has roughly the same effect as 
Demand Pattern 3. In particular, for these items, ML and 
are always preferred to MA and S 2 with MA consistently out- 
performing S 2 / however slightly. We can say, however, that on 
the average ML would have been as good or better than had 

that method been used with the same data. But, considering the 
prior assumptions made for this study, that preference is certainly 
not a strong one. 
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Forecast Method 


Group 


Characteristics 




^2 


MA 


ML 


I 


MSFE 


15.69 


16.78 


16.54 


15.65 


[2. 0,3.0] 


SD 


13.77 


14.86 


14.43 


13.67 


NR = 999 


p 

90 


39.02 


41.90 


40.56 


38.25 


II 


MSFE 


51.57 


55.11 


54.40 


51.4 2 


[4. 0,6.0] 


SD 


48.17 


51.82 


50.67 


47.99 


NR = 695 


p 

90 


111.55 


119.31 


117.40 


111.26 


III 


MSFE 


106.44 


113.81 


112.43 


106.58 


[6. 0,8.0] 


SD 


92.01 


99.22 


96.71 


92.36 


NR = 488 


^90 


286.97 


308.69 


299.04 


286.43 


IV 


MSFE 


160.44 


171.21 


169.75 


160.17 


[8.0,10.0] 


SD 


146.68 


158.17 


153.86 


145.98 


NR = 300 


^90 


346.86 


376.57 


361.13 


346.65 



Figure 4.3. Characteristics of Forecast Methods. 
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We should also remark that these results have been carried 



out as an academic study without regard to modifications in the 
real applications. But as a matter of fact, SPCC often employs 
a "trending" technique which is intended to detect any significant 
trend (up or down) in the mean of the demand distribution. The 
technique is to compute the value of 



( 1 ) 



T 



D, 



2 (Dq+D^) 

Td-Td^T-^ 



where is the demand observed in the i — past quarter. If 

Te [0.9, 1.1], a smoothing weight of a = 0.1 is used; otherwise 
a is chosen to be 0.3. Clearly, when two or more consecutive 
observations are zero, T will fail to be in the test interval. 

As we mentioned earlier, the data we have examined are 
frequently of this very nature so that, for these items, trending 
can be expected to occur quite often. But, assuming that the pat- 
terns shown in these data tend to be repetitive, trending merely 
adds another harmful effect to the forecast. That is to say, if 
the data tend to repeatedly peak and then settle back to a lower 
level (for whatever underlying causes) , trending will only add to 
exponential smoothing in placing undue weight on the misleading 
peak values. There are obvious implications here for a better 
understanding of the underlying model for the data since so many 
items are involved. 
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5 . 



Conclusions and Reconunendations 



This is the fourth in a series of reports devoted to the 
study of demand forecasting (and exponential smoothing in particu- 
lar) carried out at the Naval Postgraduate School under the spon- 
sorship of the Naval Supply Systems Command. The study is of 
particular importance to real applications since exponential 

smoothing has become a basic forecasting tool for supply systems. 

When exponential smoothing is coupled with MAD as a method 

of estimating variability, a great deal of analytical difficulty 
is encountered even when the most stable assumptions are made with 
regard to the demand distribution. All of this has been exten- 
sively documented in earlier reports and accounts for the continued 
use of simulation as an investigative tool. 

In those earlier reports, it was demonstrated that, at least 
in a constant mean model , smoothing seems to produce more variable 
predictions than some other alternatives. We set about in this 
study to try and isolate the source of that variability. In Section 
2 we have shown that exponential smoothing, rather than the use of 
MAD per se, seems to be the main contributor. While no one case 
studied can in itself be relied on too heavily due to simulation, 
the overwhelming consistency in case after case studied of improve- 
ment in variability from smoothing with MAD, through several inter- 
mediate modifications, to pure maximum likelihood leaves little 
doubt about the conclusion to be drawn. 

But demands in real life seldom have a constant mean it is 
argued. Surely for a varying mean value, an adaptive procedure 
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like exponential smoothing must be better to use than one designed 
for more stable conditions. We addressed this problem and the 
results in Section 3 show that this is sometimes true and some- 
times not. In particular, when the mean value has a sudden jump 
but then settles back to its previous level, maximum likelihood 
is still a better procedure to use. When we allowed the mean to 
change in other ways (step and ramp) however, exponential smooth- 
ing emerged as a better candidate than either maximum likelihood 
or a moving average for predicting such changes. 

Not content to rely exclusively on simulated results, how- 
ever, we retrieved real demand data for additional study. Unfor- 
tunately, only eight quarters of such demand were available for 
processing which makes generalization extremely awkward. For this 
reason, we have attempted to mollify our conclusions in Section 4 
to reflect the small sample size. To our surprise, a large number 
of items revealed demand histories that were more compatible with 
the one model of Section 3 for which maximum likelihood was a 
leader. It is not surprising then, that when the data were judged 
by the same ground rules, maximum likelihood was slightly better. 
But, with no real model available, certainly any recommendation 
would be indecisive. The best that can be said is that, had 
maximum likelihood been used on several of those items observed 
instead of exponential smoothing, the overall forecast would have 
improved, if however slightly, in some cases. 

The first recommendation growing out of this study then is 
that more should be known about the underlying model before any 
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decisive conclusions can be drawn. No respectable analysis can 
be performed on such limited histories but enough is indicated 
here to suggest the importance of getting closer to the underlying 
model. The implication for additional data storage is obvious. 

It should also be pointed out that, even apart from that, only 
five different demand patterns were studied here. Surely other, 
perhaps even more appropriate, patterns might occur to users. For 
this reason, we have included our programs in various appendices 
for modification and use by the interested reader. 

In that regard, we have added an appendix concerned with 
computational speed. A case for exponential smoothing has been 
consistently made in the past (particularly by Brown [4]) on the 
basis of computer storage and speed in computation. But computer 
technology has made giant strides in recent years. In Appendix D 
processing times for various forecasting techniques are compared 
utilizing 1968 state-of-the-art equipment. Processing times are 
even faster now and hence should no longer be a significant factor 
in the selection of forecasting techniques, at least of the types 
discussed in this report. 
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6 . Appendices 



APPENDIX A - Comparing Variability 
This program simulates normally distributed demands with 
constant mean and variance. As in the following program (Appendix B) 
the Learmonth-Lewis random number package LLRANDOM [6] was used. 

All programs were written in FORTRAN IV and run on the IBM 360/67 
computer of the W. R. Church Computer Center at the Naval Post- 
graduate School. 
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S'mAhSHJIo AkL TAiXt^'j 



ISl-Ei) CC 
PHu cl 
I'iU A.;D S 
F LI hoD 1 
MB Iff. ID 2 
MfTHLl) 3 
MT HUD f 
METHOD 5 
MLTflOU o 
i-ih T HH1> 7 



30-6C F Or. RaNUUM NK bEMLPATOR 
bl—fo SPECIFY . 0 1 » . U5 , » . iO » . 2U t • 2 6 
IbMA ARE UbK) TU INITALIZE FORECASTS 
: EXPfJNL-NT 1 all Y SMUJTHLD MAD *vlTH HEAD START 

EXPONENTIALLY SMOOTHED MAC wITH NO HEAD START 
SAMPLE STANDARD DEVIATION V-JITL. EXP SMOOTHED FCST OF MEAN 
cXPUNENT I ALLY SMGUTHED SO'UaREU ERROR WITH HEAD START 
EXPONENTIALLY SMOOTHED SQUARED ERROR WITH NO HEAD START 
K1=^RMSFE 

MAXIMUM LIKELIHOOD FlSI OF MEAN AND SO 



01 MEN'S ION X(lbO) ,F( lOU) ,E(I00| ,SDI T,100),NP{A),SM(7t^) ,jSD<7,A) , 
1 R1 (7 ,4) ,K2 ( 7,A» , SR ( 7, A ) , SkD( 7,4 ) ,F ML I 100) 

kLALv4 K1 ,K2,MU,MSFL-( r,4) 

REAL ^**3 SSu(7,4) ,RLI 7 ,4) ,KLSUI 7 ,A) tSUxil 7,4) 

Kl AL’<=a ARb ,0RD, RI Sk , iX? , SSa 3 
i 0 .) f I . i\>l AT (jl I0.4,6I3 »l10.4) 

lb, ikmat (•oerpor = Slid. 4) 

C,*LL UVFLJW 
ITYPF = 4 

] i .xiAD (5,100) AlPHA.MU, Slo 1A ,NR , ( NP( I ) , 1 =I , 4) , I SEED, RHO 
l;M PUiv IcKMiNATlJN 



If 


( Al PHA.bE 


. 1 


.0) blj 


TO 9^ 




1 




Kl (0 


. 5 


=^(2.0 




ALPHA ) ) 




= 1 . 


25jjI4 


« K 1 








ot- 


TA = 


1.0 


— 


ALPHA 










= N P I 4 


) 












RK 


= 2. 


32o 












Ir 


( RHO 


. E 0 


• 


0. 05 ) 


r<K 


- i 


.045 


: K 


( RHO 


.EQ 


• 


0.10) 


KK 


= i 


.28 2 


1 1- 


( RHO 


.LO 


• 


0.20 ) 


KK 


= 0 


, .H4 2 


\t 


( r.in 


. b w 




0.25) 


RK 


= 1. 


.0 74 


[ .X 


L “ MlJ f 


K^ 


* b 1 b fl A 








.)t) 


i A I 


^ 1 


,7 










JO 


1 1 J 


^ 1 


, H 










So 


M ( 1 , 


J ) = 


0 


• 








s 1> 


O' ( 1 , 


J ) = 


0 


• 








Kl 


( 1 , J > 


= 0 


.0 










x2( I , J ) 


= 0 


.0 










R i 


( I , J ) 


= 0 


.0 










rl 


jU( I , 


J ) = 


0 


.0 









II Cunt i nu e 
Id CONTINUE 
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■)onoooooOv '^oo 



I SOM , IM T 1 \l I /LD 

1). ' . J - 1 f TvX 

. V . I 0 1 ^ i f < ( J f 1 ) V A K 1 A ' , 5i 

i \ L L 01 ) K M AL I i J I •!!,>, M P ( < ) ) 

i I /O f v '■ S 1 ( . j ( M J f ■) 1 (.> 'I A i 

Is 1 - 1 * i'; 

/ill = Mv< * S lO-'AVk ( 1 ) 

IS C S\'I!.vUt 

i FJirCASlS .JSlOO r>P --.Mci.iMKG A MAX L 1 t- L ! • u.L J 

j n] ! 1 Al i If- 

1(11 = iiJ 

I -M ' 1 ) - '-lU 

I . ) = X 1 i ) - M'J 

•...111!) - A 1 1.) M A 



>V/ 


- 


A i i > ( f ( 1 ) ) 


A ) 


- 


X ( t ) 


O .'i A 




oX3*SX3 




r 


( X 1 gma/k 1 ) * 


:,Kn 




u ( 1) f { 1 ) 


A X ) 




S X c> 


) ^ (P 


or 


L 1- ' R L (^ A S T S 



,'K’Gf-Ar* r.OMOAPFS -+ SCHFMES F R Fl'RFCASTIKG STD DEVIATION OF DEMAND 
MUST BE .LE.lOO UNLESS DIMEMSIJN STATEMENT CHANGED 
M TpoMTr.'ATES WHEN IT =>rA0S AN ALPHA .GE. l.D 



P* HG'^ 
ALPHA 
MU 

S IGM/ 
NR 

t P ( ! ) 



CC l-io = SMOOTHING COrSTANT 

CC 11-20 = MEAN nr DEMAND DISTRIBUTION (NORMAL) 

CC 21-30 = S.D. OF DEMAND DISTPIRUTION 
CC 31-35 RIGHT JUSTIFIrD = TjUMHEP OF PERLICATICNS 
CC 36-AO, A1-A5, 46-50, 51-55 RIGHT JUSTIFIED ARE PERIODS WHERE 
SliAPSHQTS APE TAKEN 

I SEED CC 56-60 FOP RANDOM NP GEMERATOP 

PHO CC 61-70 SPECIFY . 01 , . 05 . , . 1 0, . 20 , . 25 

MU Af D SIGMA ARE USED TC INPALIZR FORECASTS 

•iFTirD l: EXPONENTIALLY S'^l OTHED MAD WITH HEAD START 

MC'^HOD 2: EXPONENTIALLY SMOOTHED MAD WITH NO HEAD START 

f.cTHnp 3 SAMPLE STANDARD DEVIATION WITH EXP SMOOTHED FCST OF MEAN 

METHi U 4 FXPONLflT I ALLY SMOOTHED SQUARED ERROR WITH HEAD START 

f ETH[ L) 5 EXPONENTIALLY SMOOTHED SQUAPFD ERROR WITH NO HEAD START 

'‘LThCD 6 Kl^RMSFE 

OFTirD 7 MAXIMUM LlKEl THCOD FCST OF MEAN AND SD 



DIN.Er;: ion X( IDO) ,F( 100),E( lOO) ,SD(7,100) ,MP(4) ,SM(7,4) ,SSD(7,4), 
1 R1(7,4),R2(7,4),SR( 7, 4 ) , SRD ( 7 , 4 ) , FML ( 100 ) 

RFAL’(^4 K1,K2,MU,»'SFE(7,4) 

PL AL#B SSQ( 7,4) , PL ( 7, 4) , RLSD( 7 ,4 ) , SUM( 7,4) 

RLALTR AR'i ,ORD,R ISK, SX3, SSX3 
mo FLP.MAT (3F10.4,6I5,E10.4) 

150 FORMAT ( 'OFPP.OR = *,ri0.4) 

CALL OVFLOW 
mYPF = 4 

10 PLAD (5,100) ALPHA,MU, SICMA,NR, ( NP ( I ) , 1= 1, 4) , I SEE0,RHO 
C "FST FOP TERMINATION 

II ( ALPHA. GE. 1.0) GO TO 99« 

K1 = SQRT( n.5*( 2.0 - ALPHA)) 

K2 = 1.253314 * K1 
BFTA 1.0 - ALPHA 
rj =NP(4) 

R(- = 2.326 

If (PHO .FO. 0.)5) PK = 1.645 

m (RHQ .EQ. 0.10) RK = 1.282 

IF (FHO .EO. 0.20) RK = 0.842 

IF (PIIO .EU. 0.25) RK = 0.674 

TFL = MU + RK* SIGMA 
or 12 I = 1,7 
D-^ 11 J = 1,4 
SUM ( I , J ) = 0. 

SSO ( I ,J ) =0. 

R1 ( I , J ) = D.o 
P2(I , J) = 0.0 

Rl ( I , J ) = 0.0 ' 

FI SD( I , J ) = 0.0 
I I Cr NTIL'UF 
12 O NTINUF 
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oo oo r> o oo no oo o n n 



c :uM5. rirr ializfd 

1)1- 50 J = 1,MR 
C 0!:r:O-ATF VAFTATFF 

CALL NORMAL ( I 5E FD , X , fj P( 4 ) ) 

0 T'-' AN'^rnpf •^1 fj( MU, SIGMA) 

nr iG I = i,N 
X( 1 ) = MU + SIGMA*X( ! ) 

15 Cf NT If;UF £ 

C C'JMPL'TE forecasts using '‘INGLE EXP SMOCHING AND MAX LIK-LIHOOD 
C I ''1 ! I A L I Z E 

f(l) = MJ 
FM(1) = MU 

F( 1 ) ^ X ( I ) - MU 
= SIGMA 
SX? = ABS( C ( 1 ) ) 

S> ? = X( 1) 

SSX3 = SX3*SX3 
SX4 = (SIGMA/K1)*=!'2 
SX6 = E( 1)*E(1 ) 

SX5 = SX6 

rr'IPUTE FORECASTS 



O'"' 2 0 I = 2,N 

F( I ) = ALPHA*X(I-1) + RE'^A*F(I-1) 

Ed) - X(I ) - F( I ) 

MLTHro 1 

S)(1,I) ^ RETA*SD( I, I-l) K2*ALPhA«ABS( E ( I-l ) ) 
MLTHnn 2 

SX2 = 8ETA--^SX2 * AL PH A «A ,iS ( E ( I ) ) 

SD(2, I ) = K2*SX2 

MITHODS 3 AND 7 
Ff*L( I ) = ( SX3 ^ MU)/ I 
SX3 = SX3 + X( I ) 

SSX3 = SSX3 * X( I )*X( I ) 

16C FORMAT ( IH , 4{ F20.4, 5X ) ) 

AEGU = (SSX3 - SX3*SX3/I)/I 
V/riTF (6,160) X( I ) ,SX3,SSX3, ARGU 
SD(3, I ) = SORT (ARGU) 

IF (ARGU .LT. 0.) STCP 

Sf)(7, ! ) = SD(3, I ) 

f'L^HOO 4 

SX4 = 8ETA*SX4 + ALPHA>!=F ( I -1 ) <« E ( I - 1 ) 

S0(4, I ) = K1*S0RT( SX4 ) 

method 5 

SX5 = BETA*SX5 + ALPHA’S'E ( I ) «E( I ) 

£3(5,1) = K1«SQRT(SX5 ) 

C MFTMOD 6 

SX6 = SX6 + E( I)<=E(I ) 

SD(6, I ) * K1«SQRT( SX6/ I ) 

20 CCNTIMUE 
c roLirc^ STATisTirs 
or 28 K = 1, 7 
DC 26 L= 1,4 

SUM (K,L) = SUM(K,L) ♦ 5D(K,NP(D) 

SGQ (K,L) = SS0(K,L) + SD( K , NP ( L ) ) ♦SO ( K , NP ( L ) ) 
IF (K ,EQ. 7) FINP(L)) = FML(NP(D) 

PC = F(NP(D) ♦ RK*SD(K,riP(L)) 

A=’G = (RO - MU) /SIGMA 

CALL NPOA (ARG, ITYPF,nRD,F ISK, ERR) 

IF (EPR .LiF. 0.0) WPdF (6,150) ERR 
R1(K,L ) = R1(K,L ) + RISK 
P2(K,L) = R2(K,L) ♦ PISK*FISK 
RL(K,L) = RL(L,L) + PO 
pLSD(K,L) = RLSD(K,L) ♦ RO*PP 
20 CCNTIMUE 
28 CrriTINUE 
50 CCriTiNUF 
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C f.OW '•r^UMiTF SAMf’LE STATISTICS 
^ ) J = 1 , A 

DWO I = 1,7 
S."( I , J ) = SUM( I , J)/^!P 

VAP = (SSOd.J) -SUM( I , J )*SUV( ! , J) /NP ) /MP 
'■SDI I , J) = SCOT (VAP ) 

‘'SIF(!,J) = VAR <■ (SIGMA - SM(I,J))**2 
'■^ ( I , J ) = P 1 { I , J ) /NP 

SMMI.J) ^ SQPT( (P2 { I , J) - PI ( I , J ) *P 1 ( I , J ) /^4R » /MR) 
i-LSU(!,J) =OSJRT( ( RLSDd ,J) - « L ( I , J ) *P L (I , J ) /NR ) /NR ) 

PI ( I ,J ) = PL ( I , J )/NP 
7 0 Ci'OTIMUF 
BO crr’^iriUE 
C riJTPilT PTCTIPf 

20C r’FMA^ (*dHE FOLLOWING PAPAMETFPS wLPh USED FOP THIS RUN:'./) 

201 r PMAl ( • OALPHA* , lOX, • = ',FIO.A,/,' MU'.ZIX,'^ '.FIG.-V,/,' SiGMA', 

1 1BX,'= •fFlO.'V,/,' NUMBEP OF REPLICATIONS = ',110,/,' RISK’, 

2 19X,'= ',010.4,/,' REDFDEP L FVEL ' , lOX , ' = ',F10.4,/,' ISEE0',18X, 

3 '=',110,/) 

2i'2 r )PMAT ( 'OOUARTER' , 19X,4(I in,5X) ) 

210 f PMAT ( '0‘'FTr(nD' , 13, 5X, 'SAMPLE MEAI' ' , 4 ( F 10. 4 , 5X ) , / , ' ',14X, 

1 'SAMPLE S.D. ' ,4(F10.4,5X) ,/ , • ' , 14X , ' MS E ' , 9X , 4 ( FI 0. 4, 5X ) , / , ' ', 

2 14X, 'SAMPLE RISK ' , 4 ( F 1 0 . 4 , 5 X ) , / , ' *,14X,'S.n. OF R I S K ' , 4( FI 0 . 4 , 

3 :)X),/,' ', 14X, 'REORDER' , 5X,4(F10. 4, 5X) ,/, ' • , 14X , ' RE ORDE R S.D.', 

4 4(F10.4,5X),/) 

FriTE (6,200) 

W^dE (6,201) ALPHA,MIJ,S IGMA,\1R,PH0,TRL, ISEED 
WPITE (6,202) (MP( I ) , I =1 ,4 ) 

O' I = 1,7 

W' !^L (6,210) I, (SM(I, J) ,J = I,4), (SSD(I,J), J=l,4), 

1 ( - ’SPPI I , J ) , J=l,4) , ($P (I , J) , J=l,4) , (SRD( I , J) , J = l,4) 

2 ,(Fl (I,J),J = 1,4),(PLSD(I,J),J=1,4) 

9 5 C. NT HUE 
GN T(i 10 
999 STOP 
END 
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APPENDIX B - Forecasts of Mean Demand 
This program consists of both a demand generator and a 
forecast analyzer. In the generator, normally distributed demand 
is first generated and then transformed into the five patterns 
outlined in Section 3. In the analyzer, each of the four forecast 
methods outlined in Section 3 is tested against all five demand 
patterns. For the two smoothing techniques, the usual relation- 

t 

ship 



^itl 



(1-a) f . + ax . 
1 1 



was used. For maximum likelihood it was assumed that demands had 
been recorded for 20 periods prior to the initial testing period 
and that the 20 period average coincided with the parameter mean 
used in the generator. For the eight quarter moving average, 
eight extra quarters of demand were first generated for a set of 
initial conditions whereupon the relationship 



f . 

1 









was used to forecast. The program follows. 



(, C.JMPaWLS VARHJUb TLuHMJUfS FQK FOKtCASriNG DEMAND. 

I MEAN RANK AkF CDMPUTlD RUK EACH. VARIOUS NON-S T AT I JN A HY 

i NORMALLY Dl^iTRlHUTEU DEMAND PATTFHNS ARE CGNSIOERFD. 

c DATA INPUTS: MU CC i-lU 

( SIbMA 11-^0 

C DEM PATTlKM 23 

C .JNt CAaO will RU'J OLMAND PAITtKNS LRUrt OP 1U 3 
L NK REPLICATIONS H-35 

(. NH PERIUDS Al-'tS 

i ISCID 31 -d3 

t pK(jb«AI-t TEK.-1INATES WHEN NEGATIVE MU ENClUNTERED. 

L, T r C H j 1 vUE S UsE D ARE: 

1. SS.l (SINGLl SMUUThINo wITm ALPHA = .1) 

C 2. SS.2 ISINGLF SMfJUThlNG WITH ALPHA = .2) 

L j. MLE20 (MAX LIKELIHOUO ASSUMINi, 20 oiRS PRIOR EXISTENCE) 

C A. MAd (8 DTR MuVlNU AVLKAbf) 

( i\iJ:-sTAT lONArU TY IS A.'ji.UMfO T(l COMMERCE IN PERUIH 3. 

t St 

is the forecast for the (i+1) — period using x^ as the 
most recent observation. 
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c 

r 



f- \1 Tr 

r r* 

r f‘ 

’ATI i 
• ATT. 



inK 



N '>( 
\\ 



1 : 

> • 

> • 

4 : 

j : 



‘30»» STcP liNiCHEiiSt: 
IvJO'-g SFFP I\CHFASc 
lJO.g SPIKL 
13 % KA^.P 

10:i. KA'IP I ,1k ^ .,TkS, 



H L N L . L L 



'< t Ui. 'I' J 
i -j r L > L t\ ■ » p 

i -U >IS [ l lf-4 A ( 1 00 ) t V ( d > 



f r 



( 1 



.. J 
1 ) 
1 1 



Li 



d i ‘W ( 4 ) * S I.J M I A ) f Z ( H ) 



A , 1 5 , d ( t) X , 1 i) ) , t I 0 . t I 

N , 1 SO 



A I A O 

r Kf.U IZEIO 

LALL jvfljw 

nl.Ac- (‘d,100) MU,S1G'^A,0P,0 k, 

IP ('^U.Lf.O.) GO ru 909 
I.^.LO = li>.) 

TIALIZ- ArvkAYi 
i) . 10 1 ^ 1 f 9 

«.VNK([J = 0. 

o u Yi ( 1 } — 0 • 

> S V. ( 1 ) = 0 . 

, IM I '\JI 
AK OAIN LOOP 
l)li 9) J l,l'Jk 
* i'AlL I, (0,1) Ot.MAO'JS 
•..-.LL -nIAhMAL <JSEFu,X,N) 

I K AO^PliKit P!(vdr IWO OtidLKV AT I Of>iS 
All) = MU *■ S IGMA^X 1 1 ) 

X(2) = MU * SrOMA*X(0) 

. --'ATi PR(VICUS d JTGS OLMAND kUP 
(. vLL K IRMAL (ISLEUfYfd) 

■ ) ■ ' 1 o 1 — I f d 

/ I 1 J = MU k S IGMA’i'Y i I j 
^..O.NT 1 N-JF 

w SrLt.C) Ut.MANO PATTFkiM AGO 
d I TO {21,22,03,24,05) ,f)P 
0. dl 1 = J,N 

+ 



)0) ,KAAik('i) ,KFY(^) 

, SFE 



1( 



MilVl.MG AVEkAoF 



TkAN^iFOkM Kf, mailing JEMANDS 



I 



^ I 



..(,') = 1 
(... M 1 TUE 



t>-MU 



S K.MAkX ( 1 ) 






( I 

A ( 

0 .. 

X( 



1 ) 50 

; o A 2 { ^ , N 

/> ( f ) = 2.0*MU 

J T I \i u k. 

UJ 5 0 

3) = 2.0--XMU 

33 1 = 

1 ) = MU 
dOMT 1 \UE 
uO To dO 
Oi • 3 *♦ 1 = 3 r N 

A I I ) = I 1 . .) ♦ 

C I J G T 1 1'i U E 
GO TO 50 
X( 1) = I . 1 =?MU 

UO 35 I = 4 ,N 
X{ I ) = 1 .2*MU 

(. OTIUJL- 

c:'f Tr;UF 

rriD ulMA(U) GCNE-^AA-op 

■^CCHt TOUT l: SS.l 

r ( 1 ) = foj 

•^FEl = (X(l) - ML1)’^(X(1) 

STF = SFEl 
nr 52 I = 2,N 
f ( ! ) = C.9-^-F( I-l ) 

Srt = SFE + ( X( I ) 

52 r r TMJF 

Z(l) = SFE/N 
■^rCH^ lOUE 2 : SS.2 

El L ^ SFFl 
rr 54 I = 2,N 
M I ) = 0.3’^F (I-l ) 

SAP = SFF + (X(I ) 

5A ailTTJUE 

Z(2) = SFF/M 



3. 



2d 



J d 

50 



+ S 1 GMA*X { I ) 



*■ S IG:'iA<=X { 3) 

“+ , M 

*■ SloMA>!=X(l) 



( 1- *0. 1 ) «MU + S 1GMm^‘ ' ( 1 ) 

+ SIoMA*X(3) 

«■ S 1 GMa^^X I I ) 



BEGIN FOREOAST ANALYZER 



MU) 



i*y( I-l ) 
r ( I ) )*-fr2 



0.2>^X{ I-l) 
r ( I ) )**2 
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C ^ LCir I i: MLE20 

i;rf = ?rFi 
Pf 56 ! = 2,I'I 

F(!) - {(IP. + I)^F(l-l) X(I-l))/(19. -e I) 

= SFF + ( xn ) - r ( M >=^4^2 

5o O r■TI^ IJF 

Z(3) = SPr/M 

C "FCHflOMF A: ma3 

YSHM - Y(l) 

O' 5 3 I = 2f8 

v'-i'fr = YSlP' <■ Y( I ) 

5 5 C I T !f UF 

F(l) = YSll'''/8.n 
'■PL = (X(l) - F(l) 

C" 60 I = 2,8 

FC) = F(I-l) + (X(I-1» - Y(I-l))/8.0 
SI F = SFF + (X( I ) - F{ I ) M «2 
■-■J C.J.T!njE 

M (fi.LF.P3) GC T-j 6A 
r (9) = F(8 ) + (X(8) -Y(8) ) /8.0 

SFF = SFF + (X(9 ) - F ( 9) )-^*2 
ir 62 I = 10,N 

F(l) = F(I-l) ^ (X(I-l) - X(I-9))/3.0 
SFL = SFF + (X( I ) - F( I ) )*^=2 
62 '■i-fiTIMUF 

6 A Z(A) = SFF/N 

O' 8( I = 1,A 

C| ' ( I ) = SUM ( I ) + z( I ) 

S^ 9( T ) = S!'0( 3 ) Zl J ) ’^•Z ( ■ ) 

/',6 n f T UE 
: ' 'vj Cl iiru^b 

P. 8 8 I = 1,A 

KFYd) = I 
f 3 f I f ■^ir 

CALL SHSHFT (Z,KEY,A) 

0' 89 I = 1,4 

F/‘ K(i^FY{ 1 ) ) = PAf'K(KFY(n) +■ I 
;>9 C'f.TIMJE 
90 C FTT‘uF 
C FS'D "AIM 

•" fl'TW CCMPTLF STATISTICS 
O' 92 I = 1,4 

C wAfiK 

"or K ( I ) = PANK(I)/MR 
r <^Af’PlF MFAM IF MSFE'S 
Y(I) ^ SU"(I)/MR 

C <'Af<r>iL STAMOAPD DEVIATIPM OF YSFE’S 

Vr-T = (SSO(I) - SUM( I )«SUM(I )/NR)/MP 
IF { VA? .1 •". 0.0 ) GO TO 600 
‘1 Z( ! ) = SORT (VAR ) 

t'2 C'pTTfujP 
C f U^tn-r SFCTT'-f. 

tff-M’T ( ’6,1 ,///////, • p(.D '/-ETEOS USED FOR THIS RUM:',//,' MU 

1 Fir-.4,/,’ Sir,MA' ,15X,F10.4,/,‘ DFMAMD P ATT ER N • , 6 X , I 1 0 , / , 

2 ' '^FPl. IC ATIOMS 1 , SX, I 10,/ , ' PEPinuS* ,13X,I10,//) 

2. 1 Fr PMA'- ( 'GPFTUOQ. , 15X, ’ME' \|* , 1 IX, "'-SFE ' , ex, •SA,'^Pl.E • , / , 16X, ' 

1 23X, 'STD DEV',/) 

2P2 F' t'MA’- ( 'O', I6,4X,3F15.4) 

Wc iTf (6,200) MIJ, SIGMA ,0P, MR ,M 
V Mtl (6,2C1) 

O: 210 I = 1,4 

W-ITF (6,202) I,PAMK( I ), Y( I ) ,Z(I ) 

210 C-8Tir:UE 

IF (DP .FQ. 5) GO Tf 10 
DP = DP + 1 
G.. Tf' 11 

250 {.it = ' , 110, /, 'OSUfM I ) = * , F 1 5 . 6 , / , ' OS S 0( I) = ',E15. 

1 'OOFMAMO PATTERN = • , I 1 } , / , ' OV AP = *,E15.6,//) 

600 W! ITF (6,250) I , SUM ( 1 ) , S SO ( I ) , DP , V AP 
VAF = 0.0 
GF -r 91 

CiC C^ CTf p 

tf n 



• , 18X, 
RANK' , 



6 , / , 
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APPENDIX C - Comparing SPCC Data 
The assumptions leading to an initial forecast for each of 
the forecasting schemes examined were discussed in Section 4 . 

Once these are given, forecasting then proceeds as in Appendix B. 
In connection with both maximum likelihood and moving average, 
it was assumed further that eight previous demands, each equal to 
the initial forecast, was part of the recorded history. Some 
assumption of this nature is essential for the computational forms 
required. These matters are obvious in the program which follows. 



C CCMPAP.tl 4 hCF'PCAS'^ING ^ECHMIQUlS USING SPCC DATA 

C CCGSIDfcPS items WHC SE AVG DEMAMi) IS BETWEEN UL AND DM 

C csril = s i ,CSf E 2 = SS.2,CSFE3=MA8,CSEE4=MLE8 

C 
C 

REAL*4 SSI (100G),SS2 ( 1 OC 0 ) , A8 ( 1C 00 ) , E 8( 10 00 ) , X { 1 0 » , Y ( 10 ) 
lMThGEP=^4 A(10),h(10),0(10,8) 

100 ECPRAT ( 10(2X,2A4,20X,8I 10,F8.2,F7.2)) 

200 FOP 1AT ( IX, I5,2X,2A4,8I4,2X,2(-9.2,4F15.a) 

300 F..PMAT ( 1h 1,4X,'N' ,6X, 'Nl IN' ,2X, 'DO' ,2X, 'Dl' ,2X, M)2' ,2X, 'D3' ,2X, 

1 '1)4' ,2X, 'D5' ,2X, '1)6' ,2X, '07' , 7X, 'MEAN' ,6X, ' VMP ' ,3X, ' SMOOTH I MG .1 

2 ' , 3X , ' SMnCTtllNG .2',' MOVING A VER AGE ' , 12 X , ' M L E ' J 
DAT/; NR, F0,[)L, DH/0,2 .5,2.0,3.0/ 

CALL EPRSET (218,300,-1, 1) 
v)RI‘"t ( 3,300) 

REV«!Nl) 2 

5 READ (2, 100,EMD=20 ) ( ( A ( I I , fi (I ) , ( 0 ( I , J ) , J = 1 , 8 ) , X ( I ) , Y ( I) ) , I = 1 , 1 0 I 

DO 10 I = 1,10 

IF ((Xm.LT.DL ) .CR.(X( I) .GT.DH )) GU TO 10 
NR ^ MR 1 

CALI FCST(f),SSl ,SS2 , MA 8 , MLE8 , NR , I , FO ) 

WPI^E (6,2U0) NR ,A( ! ) ,H( I ) , (D( I , J) , J = 1 ,8 ) , X( I ) , Y( I I ,SS1 (MR), 

1 SS2 ( IR) ,MA8(NR) ,MLE8(MR) 

IF (NR.GT.IOOO) GO TP 20 
10 CLIJTIMUL 
GO TO 5 



20 CALL 


f(I 5TG( SSI 


,MP, 0 ) 


CALL 


H1STG(SS2 


,MR,0 ) 


CALL 


hISTG(MA8, 


MF ,0) 


CALL 


HISTG(HLE0 


,NR,G ) 


ST'l’f" 






END 
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bUBFOUTIilL f CST(U,'“>Sl,S:>2,M;'.8,Ml.t:8, IF,!, TO) 
ir^TECER-^'4 0(10,8) 

R(:al* 4 SSI (L0u;,),SS2 ( lot }) ,M48 ( 1000) ,‘’LEe( LOGO ) 
F = FO 

5 F E 1 = ( F - 0 ( 1 , 6 ) ) - «2 
r SS.l FORECASTS 

SFE = SFEl 
D1 50 K = 1,7 
J - 8 ““ K 

F = 0.9-<F + 0.1-1?( I , J+1) 

50 SFE = Sf t + ( F - D( : , J ) ) **2 
SSI (NR) = SFE 
C 3S.2 FlRECASTS 

F = FO 
SFE = SFFl 
DO 52 K = 1,7 
J ~ 8 ~ K 

F = C.8-F + 0,2*D( I , J+1) 

52 SFE = Sf E + (F - D(I ,J))**2 
SS2(Nr<) = SFE 
C MAS FnR^^CA5■^S 

F = FO 
SFE = SFEl 
DO 5 A K = 1,7 
J — 8 ■” K 

F = F + 0.12 5*(L)(I,J + 1) - FO) 

5A SFh = SFE + (F - 0(I,J))**2 
MA8(NR) = SFE 
C MLF3 FORECASTS 

F = FO 
SFE = SFEl 
DO 56 K = 1,7 
J - 8 “ K 

F = ((K+7.0)’^F + on ,J + 1) )/(K + b.O) 

5o SFE = SFE + ( F - D( I , J ) ) ’^=*2 
MLE8(NP) = SFE 
RETURN 
END 
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APPENDIX D - Computation Times 
The following comparisons are based on processing times 
for an IBM 360/65 computer using 1968 technology. For newer 
large computers, such as the Burroughs 3500 presently installed 
at Naval Supply Centers, times will be faster. This is particu- 
larly true for division and square root operations. All times 
reported here are in microseconds (10 ^ seconds) . 

The summary table below has the following legend. 

A. Exponential Smoothing. 

B. Maximum Likelihood (Mean) . 

C. Moving Average. 

D. Exponentially Smoothed MAD. 

E. Maximum Likelihood (Standard Deviation). 

F. Exponentially Smoothed Squared Error. 

G. Root Mean Squared Forecast Error. 



TIME PER OPERATION 


NUMBER OF OPERATIONS 


A 


B 


C 


D 


E 


F 


G 


Additions 


(0.65) 


1 


2 


1 


1 


2 


1 


1 


Subtractions 


(0.65) 


1 


0 


1 


1 


1 


1 


1 


Multiplications 


(4.05) 


2 


0 


1 


3 


2 


4 


2 


Divisions 


(6.55) 


0 


1 


0 


0 


2 


0 


1 


Absolute Value 


(0.95) 


1 


0 


0 


1 


0 


0 


0 


Square Root 


(59.1) 


0 


0 


0 


0 


1 


1 


1 


Total 


10.35 


7.85 


5.35 


14.40 


82.25 


76.60 


75.05 



Table D.l. Times Versus Operations (Per Iteration). 
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From the table we see that the difference in processing 
time for the various methods of forecasting mean demand (A, B, C) 
is less than one second per 100,000 iterations. For estimators 
of variability, the difference is less than seven seconds per 
100,000 iterations. For the kinds of estimators that we have been 
discussing, then, processing time certainly ought not to be an 
overriding factor in choosing one method over another. 
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